
(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 

'"'"^Tsz:^'''^^ iBimiiBiiiHiiuiniii 

(43) Internatiooal Publication Date (10) International Publication Number 

4 October 2001 (04.10.2001) pCT WO 01/73598 A2 

(51) Internatioaal Patent Classification^: G06F 17A30 CAMPUN, Alison, F.; Prof. Holsdaan 6. NI^5656 AA 

Eindhoven (NL). 

(21) International AppUcationNumben PCT^EP01AI3194 

(74) Agent: GROENENDAAL» Antonins, M.; Interna- 

(22) International Filing Date: 21 March 2001 (21.03.2001) tionaal Ocliooilnireau B.V., Ptof HolsUaan 6, NL-5656 AA 



Eindhoven (NL). 
(81) Designated States (national): ON, JP, KR. 



(25) Filing Language: English 

(26) Publication Language: English 

(84) Designated States (regional): European patent (AT, BE, 

(30) Priority Data: CH, CY, DE, DK, ES, FI, PR, GB, GR, IE, IT, LU, MC, 

09/537,496 29 March 2000 (29.03.2000) US NL, PT, SE, TR). 

(71) Applicant: KONINKLUKE PHILIPS ELECTRON- Published: 

ICS N.V. [NL/NL]; Groenewoudseweg 1, NL-5621 BA — without international search report and to be republished 

Eindhoven (NL). t^pon receipt of that report 

(72) Inventors: NKOLOVSKA, Lira; Prof. Holstlaan 6, For two-letter codes and other abbreviations, nfer to the "Guid- 

^5 NL-SfiSS AA Eindhoven (NL). MARTINO, Jacquelyn, once Notes on Codes and Abbreviations" t^jpearif^ at the begin- 

A.; Fkof. Holstlaan 6, NL-5656 AA Undhoven (NL). ning of each regular issue of the PCT Gazette. 



^ (54) Title: SEARCH USER INTERFACE WITH ENHANCED ACCESSIBILITY AND EASEOF-USE FEATURES BASED ON 
^ VISUAL METAPHORS 

00 

On (57) Abstract: A user inter£u;e for querying and displaying records from a database employs a physicci metaphor for the process of 
^ constructing queries and viewing results. In one embodiment, the search criteria are displayed as stiings of beads in a three-dimen- 
sioiiol scene, eadi bead lepiesenting a criterion and each string lepiesenting a difierent category. Fiyr example the criteria, drama, 
^ action, suspense, and hoiror may be included in a category of genre. Criteria are selected to form a query by moving corresponding 
Q beads to a query string. In general, a three-dimensional scene is constrncted in which objects may bo manipulated to change their 
physical leladonships to other objects in the scene. These changes may indicate changes in a current query being defined or edited, 
a i.urrcnt profile being defined or edited, a goodness of fit of results to a given search, etc. The threc-dimcnsiona] nature of the scene 
is asymmetric to take advantage of the multiple dimensions for purposes of diffierentiati*;'.: objec'^^ * -* iic ocxme such that vaiying 
\^ positions along one dimension indicate variation with respect to a characteristic CQntespor!t.*ng to \>r.': '.imenrion. 
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Search user interface with enhanced accessibility and ease-of-use featuies based on visual 
metaphors 



BACKGROUND OF THE INVENTION 

Hie ptesent invention relates to search, rctdeval, and organization of data from 
large data spaces such as the contents of CD ROMS, electronic program guides, die Internet, 
etc. 

S The vast amount of information available in CD-ROMS, the Internet, 

television programming guides, the proposed national informadon infiastructure, etc. spur the 
dream of easy access to many large information media sources. Such increased access to 
information is likely to be useful, but the prospect of such laige amounts of information 
presents new challmges for the design of user interfaces for information access. For example, 

10 Internet users often struggle to find information sources or give iqp in die face of tfie difficulty 
of constructing search queries and visualizing the results of queries. Straight text lists such as 
provided by electronic program guides, Intemet search engines, and text search tools such as 
Fblio®, arc tedious to work with, oRen hard to work with, and, because of the rather 
monotonous look, rather tiring to look at for long periods of time. 

IS There are two major components to searching databases: filtering so irrelevant 

information is excluded, and sorting the filtered results by some priority schema. For 
example, an Intemet search engine such as Google® uses a text query to filter and sort 
records in its database rcpresenting entry points in the World-Wide-Web. ft uses certain 
implicit criteria such as an implied vote '"cast* ' by pages that link to the candidates rctrieved 

20 by the query (That is, pages that arc linked to by morc other pages, have morc 

^Votes'O-Ooogle also analyzes the pages that cast the votes and gives greater weight to pages 
that receive morc votes by other pages. 

Tools such as Google and most other database rctrieval tools dccepi search 
queries in die form of text with connectors and results arc presented in the form of lists sorted 

25 by some specific lump criterion which might be an operator involving multiple criteria (such 
as sort by A, then by B, etc). 
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SUMMARY OF TEffi INVENTION 

Briefly, a graphical us^ interface (UI) provides a convenient and intuitive 
mechanism for interacting with large databases. Hie UI provides a three-dimensional 
metaphor for the processes of searching a data space and for viewing results. The UI also 
S seamlessly incorporates various search elements, such as implicit and explicit user profiles, 
into the metaphor. In one embodiment, the search criteria are shown as strings of beads in a 
three-dimensional scene, each bead representing a criterion and each string representing a 
different category. For example the criteria, drama, action, suspense, and horror may be 
included in a category of genre. Critoia are selected to form a query by moving 

10 corresponding beads to a query string. User preference profiles can be constructed in tihe 
same way. Ptofiles can be saved and represmted as bead strings that can be used in further 
interactions in the same manner as criteria beads. Results are displayed in a tihie&- 
dimrasional scene also. The accuracy of the match betwe» retrieved records and the query 
CQneq>ond to the placement of results, also represmted as beads, along the Z-axis of die 

IS scene. 

The UI design addresses various problenofi with user interaction with databa^ 
search devices in the - lean-back** environment Qn the 'lean bac]^* situaticm the usee is bdng 
entertained and relaxes as whra the user watches television, and in the 'lean-forward*' 
situation the user is active and focused as when the user uses a desktop coiiq[nita:.)P6r 

20 exanq>le, the invention nmy be used to int^act with electronic program^ 

with broadcast television. Jn such an application, the UI may be diq)layed as a layer directly 
on top of Rerecorded or broadcast pragram or selectively on its own screen. The UI may be 
accessed using a ample handheld controller. la a preferred embodiment, die controller has 
vertical and horizontal scroll buttons and only a few specialized buttons to access the various 

25 operating modes directly. 

The UI ^erates three environments or worlds: a search world, aprofiling 
world, and an overview worid. Assuming an EPG environment, in the search world, the user 
enters, saves, and edits filtering and sorting critwia (time of day, day of week, genre, etc.).In 
the profiling world, the user generates and modifies explicit (and some types of implicit) user 

30 profiles. Explicit profiles are the set of likes and dislikes a user has entered to rq)resent his 
preferences. Each can be selected fiom lists of criteria such as genre (movies, game shows, 
educational, etc.), channel (ABC, MTV, CSPAN, etc.), actors (Jodie Fbster, Tom Cruise, 
Ricardo Bonini, etc.), and so on. In the overview world, the user views and selects among 
die results of the search, which is a result of the sorting, filtering, and im>fifing information. 
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Ttie invCTtion may be used in connection with various different searching 
functions. For example, in a piefened embodiment designed around EPGs, there aie three 
basic searching functions provided: (1) Filtering, (2) Hltering and/or sorting by explicit 
profile, and (3) Sorting by implicit profile. These are defined as follows. 
S (1) lUtering - A set of criteria that defines the set of results to be displayed. 

These criteria choose exacdy what records in the database wiU be chosen and which will be 
excluded from the overview world display. 

(2) Filt^ing and/or sorting by explicit profile - A user is permitted to specify 
likes or dislikes by making selections from various categories. For example, the user can 

10 indicate that dramas and action movies are favored and that certain actors ate disfavored. 

These criteria are then applied to sort the records returned by die filtrang process. The degree 
of importance of the criteria may also be spedfied, allfaough the complexity of adding tiiis 
layer may make its addition to a systm less worthwhile for the vast majority of users. 

As an example of the second type of systsem, one EP plication (BP 

1 S 085464S A2) describes a system that aiables a user to enter g^eric pr e ferences such as a 
preferred program category, for example, sitcom, dramatic series, old movies, etc. Hie 
application also describes prefermce tecoplates in which preference profiles can be selected, 
for exanq>le, one for children a^ 10-12, anotiier for teenage girls, another for airplane 
hobbyists, etc. This method of inputting requires that a user have the capacity to make 

20 . gmeralizationsabouthiHi/herself andtfaattiiesebeati^ 

also be a difficult task for common people to answer questions about abstractions such as: 
Do you like dramas or action movies?" and '^w important is the 'drama' criteria to you?** 

(3) Sorting by implicit profile - This is a profile tiiat is generated passively by 
having the system **observe'* user behavior. The user merely makes viewing (recoxxJing, 

25 downloading, or otherwise "^ising^ choices in the normal fashion and the system gradually 
builds a p^:8onal preference database by extracting a modd of the user's behavior from the 
choices. This process can be chanced by permitting the user to rate material (for example on 
a scale of one to five stars). The system uses this model to make predictions about what the 
user would prefer to watch in the future. The process of extracting predictions from a viewing 

30 history, or specification of degree of desirability, can follow simple algorithms, such as 

marking apparent favorites after repeated requests for the same item. It can be a sophisticated 
machine-learning process such as a decision-tree technique with a large number of inputs 
(degrees of fteedom).Such models, generaUy speaking, look for patterns in the user's 
intmction bdiavior (i.e., interaction with the III for making selections). 
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An example of this type of piofile infoimation is MbTV, a system that learns 
viewers* television watching preferences by monitoring their viewing patterns. MbTV 
operates transparently and builds a profile of a viewer's tastes. Hds profile is used to provide 
services, for example, recommending television programs the viewer might be interested in 
5 watching. MbTV learns about each of its view^'s tastes and uses what it learns to 

recommend upcoming programs. MbTV can help viewers schedule their television watching 
time by alerting them to desirable iq)coming programs, and v^tfa the addition of a storage 
device, automatically record tihiese progfwm whra the viewer is absent. 

MbTV has aPcefecmce Determination Engine and a Storage Management 

10 Rigine. These are used to fadUtatetime-shified television. MbTV c^ 

raAer than singly suggest, desirable programming. MbTV's Storage Management ^gine 
tries to insure tliat the storage device has the optimal contents. This process involves tracking 
which recorded programs have been viewed (conqpletely or partially), and which are ignored. 
Viewers can "lock" recorded programs for fixture viewing in order to prevent deletion. Hie 

15 ways in which viewers handle program sug^tions or recorded content provides additional 
feedback to MbTV's preference engine which uses this information to refine fitture decisions. 

MbTV wiU reserve aportion of the recording space to represrat each 
"constiturat interest "Tliese "interests" may translate into difF(^:ent family members or could 
represent dififeient taste categories . Ihougjh MbTV does not require user intervention, it is 

20 customizable by those diat want to fine-tune its capabilities. Viewers can influence the 

"storage budget" for differoit types of jnograms. F6r example, a viewer coig^t indicate that, 
thougih die children watch flie majority of television in a household, no more than 25% of the 
recording space should be consumed by childr^'s programs. 

Note that search criteria, and implicit and explicit profiles, may produce 

25 reliability or ranking estimates for each proposed record in the searched database rather dian 
just '*yes'* and "no" results for each candidate record in the database. A search query can be 
treated as providing criteria, each of which must be satisfied by the search results. la this 
case, if a query contains a specified channel and a specified time range, then only records 
satisfying both criteria will be returned. The same search query could be treated as expressing 

30 preferences in which case, records that do not satisfy both criteria could be returned, and, 
instead of filtering, the records are sorted according to how good a match Ifaey are to the 
criteria. So, records satisfying both criteria would be ranked highest, records satisfying only 
one criterion would be ranked second-hi^est, and records satisfying neither criterion would 
be ranked last Intermediate ranking could be p^ormed by the closeness of the record 
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cnterioa to die query or profile cntedon. For example, in the example above, if a record is 
clos^ to the specified time range, it would be ranked hi^er dian a record that further in time 
from the specified time range. 

Jn flie case of implicit profiles, there may not be any criteria at all in the sense 
5 that one could show how high each genre, for example, is ranted If, for example, a neur^ 
network*based predicting engine were used to sort the records of the database, there is no 
clear way to expose the criteria weighting that is used to make the decisions, at least for an 
easy-to-use system. However, some simpler machine learning techniques may also be used 
for producing and implementmg implicit profiles. For example, the oiteria appearing in 

10 selected records (or records ranked highly as highly desirable) can be scored based on the 
fiiequency of criteria hits. Fbr examqple, in an EPG, if all the programs that are selected for 
viewing are daytime so^s, the so^ genre and daytime time range would have a high 
fiiequmcy count and the science documentary g/stm would have zero hits. Tliese could be 
exposed so diat the viewer can see tiiem. In the user inter&ce embodiments described below, 

IS in which profiles are edited, the user may edit such an implicit profile because it is based, on 
specific wdghts qyplied to each aitaion. A user can remove the criterion fix>m the profile, 
change the weighting, etc. The latter is only an exanqile of an implicit profiling mechanism 
that provides aclear way for die user to modify it Other mechanisms may also provide such 
a scheme; for example the system need not be based only on freguoicy of hits of die user's 

20 selections. 

Construc^on of the queries for filtering and pivf&[cnco ^plication is 
preferably done with dnee dimensional visual graphics to fiadlitate the organization of 
information and to allow users to manipulate elements of a scene ^tokens") that represent 
data records, search and sort criteria, etc. :bi a prefecxed UI, die tokens take die form of beads. 

25 Categories are represented as strings or loops of beads. When a preference filter is i j 
constructed, specific choices (beads) are taken from a category string and added to a search 
string or bin. The beads, strings, and bins are represented as three-dimensional objects, which 
is more than just for appearances in that it serves as a cue for the additional meaning that the 
third dimension provides: generally an object's proximity to the us^ represents its relative 

30 ranking in the particular context 

Where the strings represent criteria, the ranking of criteria in each category 
may correspond to the frequency with which the criteria are used by the user in constmcting 
queries. So, for example, if die user's searches always include die daytime time range, the 
bead or beads corresponding to ttus time ran^ would be ranked higher. Alternatively, flie 
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criteria may be ranked according to selected records, rather than by all the records (or at least 
the most highly ranked ones) returned by searching. 

One or more categories may actually be constructed of words, for example 
keywords, that tqrpear in a large proportion of the chosen programs or a large proportion of 
S the hits returned by the user's queries. Itiis makes sense because requiring the keyword 

category to contain every conceivable keyword would be awkward Extracting the significant 
keywords from the descriptions of chosen records and/or from records returned by the 
qumies based on frequency of occunence or a variation thereof, makes the number of 
possible keywords easi^ to handle and easier to select Preferably, the keyword list should be 

10 editable by die user in the same fashion as described in detail with respect to die editing of 
profiles elsewhere in the specification. To construct a keyword list based on beqaaicy of use 
data, the system could start with no keywords at all. Then, each time the user enters a qu^, 
tiie returned results could be scanned for common terms! The rifles, descriptions, or any oth^ 
data could be scanned and those tenns that occur with some degree of fisquency could be 

15 stored in a keyword list Ihekeywcttds in the list coiddeadi be 

frequency wdghted by the context in which the keyword ^peared. For exanq>le» a keyword 
in a title might recdve a lower rank than a keyword in a description or a keyword diat is a 
direct object or subject in a grammatical parsing of a sentence in a description might receive 
a higher ranking than indkect objects, etc. Instead of extracting keywords from the returned 

20 records of a seacdi, tfie keywords could be retracted from only the records selected for use. 
F6r example, only programs that are chosen for viewing or recording are actually used to 
form the keyword list in the marmer described. Alternatively both selections and returns of 
queries could be used, but the keywords in the selected records could be weighted more 
strongly than keywords in other returned records. 

25 The overview worid presents the results of filtering and sorting criteria in a 

visually clear and simple way. Preferably, a three-dimOTsional animation is shown with 
three-dimensional tokens representing each record. Again, die (apparent) closeness of the 
token to the user rq)resents the prediction of how much the user, according to the selections 
that are active, would prefer the item identified by the record. That is, proximity, irutially, 

30 represents goodness of fit In one example of tiiis, the bead strings, each bead representing a 
record, are shown axially aligned with die string witii die best fits being arranged closest to 
the user and the others receding into the background according to their degree of fit The user 
can advance in an axial dkection to search through the results as if walking through a turmel. 
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A pointer can be moved among the beads to select tfaem. Hiis causes additional infonnation 
about each to be exposed 

Hie implicit and explicit user profiles are invoked by adding them to the 
search qu^es (the fain or string just as done with other choices. The effect of adding the 
S profile is to have tesults sorted according to ttie preferences. Explicit user profiles are 
gen^ated in the same way. 

The invention will be described in connectian with certain preferred 
embodiments, with reference to the following illustrative figures so that it may be more fully 
undeistood. With reference to the figures, it is stressed that the particulars shown are by way 

10 of example and for^urposes of illustrative discussion of die preferred embodimoQts of the 
present invention only, and are presented in the cause of providing what is believed to be tiie 
most usefid and readily understood descripdon of the principles and conceptual aspects of the 
invention. In this regard, no attempt is made to show structural details of (he invention in 
mcie detafl dum is necessary for a fundamental understanding of the invention, ttie 

IS description taken with the drawings making apparent to those skilled in the art how the 
sevraal forms of die invention may be embodied in practice. 

BRIEF DESCaUPnON OF THE DRAWINGS 

20 HG. lis an iUiistration of a hardware system that may be used to implem^t 

an embodiment of the invention. 

FIG. 2 is an illustration of a remote control that may be used witii an electronic 
program guide embodiment of the invention. 

HG. 3 is a flowchart illustrating various processes encompassed by the 
25 inventive user-interface. 

HG. 4 is an illustration of a user interface for forming and editing a search 

quay. 

FIG. S is an illustration of a user interface for forming and editing a uset 

profile. 

30 nG.6isaniUustrationof auserint^aceforfonningandeditingasearch 

qu^ displaying explicit and implicit profiles as search criteria. 

HG. 7 is an illustration of a user interface for forming and editmg user profiles 
where likes and dislikes are accommodated. 
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FIG. 8 is an illustration of an alternate pictorial scheme applicable to the 
embodiments of FIGS. 4-7. 

FIG. 9 is an illustration of another alternate pictorial scheme applicable to the 
embodiments of FIGS. 4-7. 
S FIG. 10 is an illustration of yet another alternate pictorial scheme ^licable to 

the CTibodiments of FIGS. 4-7. 

FIG. 11 is an illustration of yet anoth^ alternate pictorial scheme ^plicable to 
the embodimi^ of FIGS. 4-7. 

FIG. 12isaniUustrationof ausermtetfaceforWewingan^ 
10 returned ftom a search of a database consistrat at least some of the foregoing raibodiments. 

FIG. 13 is an iUustration of anodierus^mt^ace for viewing and selecting 
records ietumed fix>m a search of a database consistent with at least some of the foregoing 
embodimCTts. 

FIG. 14 is an illustration of yet anodier user int^ace for viewmg and 
1 5 selecting records returned from a search of a database consistrait with at least some of the 
foregoing embodimrats. 

FIG. 15 is an illustration of yet another us^ interface for viewing and 
selectmg records returned ftom a search of a database consistent with at least some of the 
foregoing embodunents. 

20 FIG. 16A illustrates the plane definitions that apply to the embodiment of FIG. 

16B. 

FIG. 16B is ah illustration of another us^ interface for forming and editing 
search queries and user profiles in which text is used to represent objects in a 3-D scene 
employed by the user interface. 
25 HG. 17 illustrates a text-based search result viewing scene that also uses text 

as objects in a 3-D seme. 

HG. 18 is a flow chart illustiatmg processes for keyword category generation 

and sorting. 

30 

DETAILED DESCaEUPTION OF THE PREFERRED EMBODIMENTS 
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Referring to HG. 1, the invention relates to database search and retrieval and 
is particulariy suited to lean back environments or applications where the availability of 
training is, or is desired to be, limited For exanqde, the invention may be used in connection 
with search and visualization tasks in connection with electronic program guides (EPGs). In 
S the context of televisions, EPG is applied loosely to various features that can be delivered 
using a database of program information. The program information may include titles and 
various descriptive information such as a nanative sunmaty, various keywords categoxizing 
the contmt, etc. In an embodiment, a conq)uter sends program information to a television 
230.The computer 240 may be equipped to recdve the video signal 270 and control the 

10 channel-changing function, and to allow a user to select chaimels through a tuner 245 linked 
to the computer 240 rather than through the television's tuner 230.T1ie user can then select 
the program to be viewed by higjilig^ting a desired selection from the displayed program 
sdiedule usmg the remote control 21 0 to control the computer. The conopiter 240 has a data 
link 260 duoug^ which it can recdve updated program schedule data. Hiis could be a 

1 5 telephone line cohnectable to an Internet service provider or some other suitable data 
connection. The computer 240 has amass storage device 235, for example ahard disk, to 
store program schedule infcmnaticm, program applications and upgrades, and other 
information. Mdnnation about the usef s preferraces and otter data can be uploaded into the 
compute 240 via rranovable media such as a memory card or disk 220. A great many 

20 intoiesting features are enabled by appropriately programnoing the computer 240. 

Note that many substitutions are possible in the above example hardware 
environment and all can be used in connection with the invention. The mass storage can be 
replaced by volatile memory or non-volatile memory. The data can be stored locally or 
remotely. In fact, the entire computer 240 could be replaced with a server operating offsite 

25 through a link Rather than using a remote control to send commands to the computer 240 
through an in&ared port 215, the controller coiild send commands through a data channel 260 
which could be separate from, or the same as, the physical channel carrying the video. The 
video 270 or other content can be carried by a cable, RF, or any other broadband physical 
channel or obtained from a mass storage or removable storage medium. Jt could be carried by 

30 a switched physical channel such as a phone line or a virtually switched channel such as 
ATM or other network suitable for synchronous data communication. Content could be 
asynchronous and tolerant of dropouts so that present-day IP networics could be used 
Further, the contrat of the line through which programming content is received could be 
audio, diat conversation data, web sites, or any other kind of content for which a variety of 
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selections are possible. Ttie program guide data can be received through channels other tiian 
the sq>arate data link 260JPor example, program guide information can be recdved througjh 
the same physical channel as the video or other content Jt could evm be provided throu^ 
removable data storage media such as memory card or disk 220.The remote control 210 can 
5 be rq)laced by a keyboard, voice command interface, 3D-mouse, joystick, or any other 

suitable input device. Selections can be made by moving a highlighting indicator, identifying 
a selection symbolically (e.g., by a name or number), or making selections in batch form 
tfaroii£^ a data transmission or via removable media. In the latter case, one or mose selections 
may be stored in some form and transnuttsed to tiie computer 240, bypassing die display 170 
10 altogether. For exan^le, batch data could come from a portable storage device (e.g.a personal 
digital assistant, memory card, or smart canl).Such a device could have many preferraices 
stored on it for use in various environments so as to customize the computer equipment to be 
used 

Referring now to HG. 2, a remote controller that may be used with a EPG 

IS embodiment of the invention has a simple set of keys including vertical and horizontal cursor 
keys 232 and 212, respectively. A select, *XjO" button 214 is used to tng^ actions 
dq)ending on the context in which it is pressed A search key 21 6 is used to invoke a search 
UI elemmt, described below . A profile key is used to invoke a profile UI elemmt described 
below. Start, save, reset, and delete ke^ 229, 222, 226, and 224 respectively, are used to 

20 control specific qporations depending on context as described below. 

Referring now to HG. 3, a g^eral overview of a user's interaction with the 
overall UI, which comprises search, profile, and overview worlds, may begin with the 
construction of an explicit profile in step SlOJReferring now also to HG. 4, for example, 
using a search^profile tool 90, criteria are selected by selecting a tokra 105 (typ.) (here 

25 r^resented by a bead), for example, representing the genre '^Movies** and moving them to an 
icon representing a selection bin 140JBefore they are selected, each criterion is grouped using 
a bead string visiud element, for example the Genre string 155, where each group of critaia 
resides on a particular string. When a criterion is selected, the corresponding token 105 is 
hi^^ted in some way, such as by holding or color change J n addition, fiirther 

30 information relating to the selected oit^on token may be revealed For example, the Movies 
bead 165 was selected Selected tokras are shown in the foreground of the three-dimensional 
scene permitting more mformation to be shown clearly on die screen. The Movies bead 165 
in tills exanq^le has been moved fixim the Genre string 155 to the selection bin 140.The place 
occupied by the Movies bead 165 is marked by a ghosted bead 115 after its transfer to the 
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selection bin 140 Jn the UI, it is envisioned that any of the beads may be selected and 
transfened to the selection bin 140. 

Hie search/profile tool may be navigated as follows. When the user is in the 
search area, the user can see all the category labels 130 (typ.). The categories may be chosen 
using the cursor keys 212, 2321a the figure, die Geiue string 155 may have been selected 
using the horizontal cursor keys 212» as indicated by suitable highlighting ISO or any other 
appropriate device such as changmg a color of the selected string, holding or hi^Mghting the 
characters of the ^nre label 155, increasing the character size, etc. Vfhsa die desired string 
has been selected, the GO key may be pressed to pennit selection of beads on the selected 
string. 

Nc^ that, albanati vely, die beads of non-^selected strings may be hiddra and 
only a vesdge displayed to indicate the presence of the category. Also, wh» the selected 
category reaches the far left <»: far rig^t of die screen, the strings can be tolled in the opposite 
direction to reveal more strings. Alternatively, the selected category may rraiain at the center 
of the screen and each time a horizontal scroll key 21 2 is pressed, the set of strings rolls in 
the opposite direction bringing a new string into view. 

To navigate a sdected string, the user may simply use the vertical cursor keys 
232.This'inay have tiie effect of moving die selected bead up and down or of rotating the 
entire string so the cent^ one is always the selected one. In either case, the bead strings can 
be arbitrarily long and continued downward or inward cursor guided movement results in die 
feeding of die string in the appropriate direction to reveal more beads. 

Note that in an embodiment, multiple strings may be open and die vertical and 
horizontal cursor keys 212 and 232 may be used to navigate among them widiout reselecting 
any strings. When a bead is selected, it can be moved to the search bin 140 by pressing the 
GO button 214.For example, the Movies bead in HG. 4 was selected and the GO button 214 
was pressed causing it to be moved into die search/profile bin 140 as indicated by the dotted 
arrow 142.To remove a bead from the search/profile bin 140, die user performs some action 
to move the selector to the search/profile bin 140 and selects the bead to be removed. Then 
the GO button 214 is pressed which causes the selected bead to retreat to the string fiom 
which it came. A fast way to clear all beads from the search bin 140 is to use the reset button 
226. 

Note diat die search/proffle bin 140 is labeled ''Search*' in FIG. 4.This 
indicates diat the mode the user is currenUy in. Also, the basic appearance and workings of 
the UI when in profile mode are die same as in the search mode. However, in profile mode. 
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the usCT is ^ven the option of indicating whether a criterion is liked or disliked Also, in 
search mode, a certain set of categories may be provided One is seatches that have been 
saved and another is profiles. Tliese are explained later. 

Referring now also to HG. 5, a search string 1 57 may be provided as a 
5 category in the search mode UI or in a specialized sclera. Tlie advantage of the former is that 
it renoinds the user of the availability of the saved searches. Saved searches can be shown on 
a string adjacent the search/profile bin 140 Another special category that may be presented, 
and preferably is presrated, in search mode is the profile category. This may be shown as a 
bead stdng also. 

10 After a search is created, it may be executed using the start button 228 to see 

the results of the search, or it may be saved, as indicated at 140 A, and given a name by 
pressmg Ae save button 2222^aming the search can be performed using known Ulelemoits 
such as a cucsor^key navigable on-screm keyboard such as provided with Ti vo® pmonal 
digital video recorder devices. For example, the name *Tizza" could be givm to identify a 

IS search Aatqpplies for Thursday ni^t pizza parties. 

A Previously sayed search can be accessed or edited as follows. To access the 
string, the user can use the cursor keys 21 2,214 or by pressing or holding down the search 
button 216 while in tte search mode or any other means. Tliis will highligjbt tfie search string 
IST.Thm the search beads 170 can be navigated as discussed above until Ae desired one is 

20 higlili^ted (or, equi valently, rolled to the foreground). Whien the desired search bead is 
M^ghted, the beads making up the criteria defining the selected search bead appear in t^^ 
search^rofile bin 140.To apply the crit^a defined in the selected search bead, the user may 
unmediately hit the start button 228 or the user can move to the search bin 140 and edit the 
search criteria by deleting them or adding new ones just as in the construction of a search. 

25 When tibe save button 222 is pressed in this context, however, the user is permitted to save it 
back to the original saved search bead or to a new one, allowing saved searches to be used as 
templates for new searches. 

Note that, a search bead can be added to the search bm 140 along with new 
criteria beforc invoking using the start button 228 in the construction of a new search just like 

30 any other criterion bead TUs, in effect, makes the saved search a t^nplate or starting point 
for searches, so a particular user does not have to enter die same data each time she/he 
performs a search. 

In the search mode, the user can also, select beads fiom aprofile string 156 to 
add to a search. Each bead of the profile string 156 contains a profile of a user. In an 
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embodiinent, ttie profile can be an implicit profile, an explicit profile, or a combination of 
these. The beads representing the profile may be added to a search to cause the results to be 
sorted by the pieferences they embody. Referring now also to HG. 6, implicit 158 and 
explicit 159 profiles can be displayed and accessed separately. In diis embodiment, die 
S profile beads are used independently, but added to the search bin 140 just as other criteria 
beads. 

Referring now to HG. 7, to create or edit a profile, the profile button 218 may 
be pressed at any time to invoke the profile mode. This brings up the profile mode UI 
tkmsat The profile mocfe UI wodcs the same way the search mode UI worics, except that the 

10 profile bm 140* is a partitioned container with a 'like** partition 164» whm beads for critoia 
that are favored are placed, and dislike partition 165, whm beads for criteria that are 
disfavored are placed. The location of the beads in flie respective partition indicates the 
acticm created by the profile with respect to the beads. That is, a criterion, such as movies, in 
the dislike partition 165 will cause the profile to wgia&vdy weight ne^vely records 

15 matching tiie criterion. Similady, a criterion in the like partition 164 will cause the profile to 
wdg^t positively records matching the criterion. Note that the profile's name appears at 169 
along with alabel indicating the user is in profile mode. Note also that the beads can be given 
a score tfirough a dialog box or by pressing a specialized star key multiple times to give the 
item a rating. For example, five stars could indicate an item that is hi^y favored and one 

20 star, an item tiiat is strongly disfavored To view the rating, the beads can be tagged with star 
icons, thdr colors can be changed to indicate the rating, their position in the bin can indicate 
the degree of the favored or disfavored rating, or their size can be changed Hius, the useir 
viewing the profile bin 140' would know at a glance the effect of each bead on the profile. 
The profile can be saved when die save button 222 is pressedTo select an existing profile for 

25 editing, the user has only to select die appropriate bead and press die GO button 214.To 
permit the deletion of a profile, the profile bead may be selected and the delete button 224 
pressed 

To filter current channels through a profile, the user, in the profile mode, may 
select the profile and press the start button 228.1h this way, the profile mode also acts as an 
30 advisor and the profile mode may be called a profile/advisor mode. Note that the implicit and 
explicit profiles can be reset using die reset key 226 .Lnplidt profiles may be editable or non- 
editable, depending on the system used to store information. If tiie machine learning device 
used stores criteria-based inferences, tiien tiiese could be edited exactiy as discussed with 
respect to the explicit profiles. Alternatively, iii^>licit profiles could be edited tiirou^ the use 
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of personality beads that weight different program according to a personality template 
represented by the personality bead For example, beads like **movie nut" to enq^hasize 
movies and movie-related material, "quiet-type" to de-emphasize action/thriller sorts of 
content, or "^overworked" to emphasize intellectually undemanding material, could be 
S provided to tilt the implicit profile one way or another. The same personality beads could be 
used in the search mode to make their actions effective only during a search, or incorporated 
in a saved search, or even incorpcxtated in implicit profiles. 

Referring to HO. 8, the search/jprofile mode can be inqplemented in a numb^ 
of different ways in accord with the following ideas: 

10 the use of three-dimensional pictures org^mizes the information in a way tfiat 

reduces clutter and makes relevant information and controls handy (for exan^le, much of the 
information that may be scrolled into view is shown pardy hiddm in ifae background, but it 
can be seen to suggest its existence and how to display it, for example beads on the string Aat 
are bdiind the fiont column of beads); 

IS the niore relevant information, depending on context, is shown in the 

foreground (for example, the currently selected items are shown in tihe foreground); and 
temporarily hidden information (but which is available) retreats into the background (for 
example, the way additional beads on the string can be hidden in the background). 
For example, the embodimmt of FIG. 8 Stems fix>m the same design principles. In this 

20 embodiment, instead of the bead strings scrolling left andrig^t in a straight line (like a 
cylinder), they roll about a vertical axis like a carousel. This way, there is one string that 
always at the cent^ and closest to the observer: in the 3-space scene. Here, die teyword string 
is selected since it is the one that is closest in the scene to the camera (user) vantage. Also, 
the search bin 140 is replaced with a string 140C. 

25 Note that to exploit three-dimensional scene as a vehicle for partitioning or 

organizing information, the dimensions should be rendered in such a way that they are 
independent Distributing variation along axes independentiy usually makes die scene 
asymmetric. Symmetrical 3-D forfeits the indq>endence of the variegation by constraining 
the dianges in appearance along one axis to be die same as the changes in the iqrpearance 

30 along another axis. Thus, symmetry is hostile to the use of die three-dimensional scene as a 
device for organizing data visually. Of course, diis does not mean symmetrical features 
always destroy die capacity for three-dimensional scenes to organize information effectively. 
For example, the bead tokens themselves are symmetrical Also, even though the successive 
series of bead strings look the same, an exanople of translational symmetry, each successive 



wo 01/73598 PCT/EPOl/03194 

15 

bead string lepiesents a diffeient category*. So on some level, synunetry may exist to provide 
visual clarity, but on another level, there is variegation that provides differentiation along the 
(visually) symmetric dimension. 

Referring now to HG. 9, still using the carousel concept, the bead strings are 
S moie stylized in this example. Only a few beads arc visible in the front of each string, but tfie 
dominant bead on each string is a great deal more pronounced. Again the central string 180 is 
the selected one. Here the keyword string's selection is indicated by its size and bold lines. 
Ihe search bin 140 is r^laced by a stdng 140B.This scene geonoetiy is prefened because it 
is uncluttered and would be easier to see supmmposed on a broadcast imag^. It is clear how 

10 this geometry could bellied to the odier contexts discussed with respect to 

Refening to FIG. 10, in still another example, the beads are rq>Iaced with 
boxes 410 sitting on shelves 420.The selected shelf 430 extends toward the user. Ihe search 
bin 140 is replaced by a hole 460 into which selected boxes 330 are inserted BGere, the 
shelves rotate around an axis that is horizontal and in the plane of the pa^. Shelves and 

IS boxes furdi^fiom the forward selected position (at 430) retreat into the background, for 
exanQ>le, as shown at 320 A particular box on the selected shelf can be shown as selected by 
suitablp hig^g^ting, growing the box, holding it, etc. 

Refening to FIG. 11, in still anotfa^ example, signposts are used to represent 
the set of available categories, proffles, etc. Each sign represents a category or the set of 

20 profiles. Most of the signs 480, 485, and 450 are tilted at an angle with respect to tiie point of 
view, exc^t for the selected one or ones 460, and 475.When a sign is selected, the selections 
available within the category arc exposed as tags 470 and 472 on the left side of the sign. 
Those criteria or profiles that arc selected to form pait of a search (or criteria selected for a 
profile) arc shown on the ri^t side of the sign, for example as shown at 460 and 462.The 

25 name of the currcnt search being constructed, if it is a search or the name of the profile if it is 
a profile under construction, appears at tiie bottom, for example, at 440.Thus, the array of 
selected criteria on the ri^t of the signpost conespond to tibe contents of the search bin 140 
in the bead embodiments discussed above. Navigation of the HG. 10 and 1 1 embodiments is 
analogous to navigation in the bead embodiments. Prcssing the vertical cursor keys 232 

30 causes the currraitly selected sign to swing into ''open'' position as is sign '490 in HG. 
11 Jtessing the horizontal cursor keys 212 causes the tags 460/470 to be highlighted as 
indicated by boldmg, color change, size change, etc. Tag 471 is shown as selected by a size 
and holding change. Tags can be added and removed fiiom the rig^t side of the sign post by 
selecting them. Selecting a tag toggles its position between sides of the signpost Once 
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criteria ace saved as a search, they can be made available by selecting them fiom ttieir own 
"search" sign (not shown),Any criteria not visible on the signpost can be brought into view 
by scrolling vertically* New signs will appear at the bottom and top, respectively. New tags 
will sppear at flie left and rig^t extremes. 
5 A keyword list tfiat may be used in all of the above embodiments can be 

generated dynamically, ratho: than ficom a generic template. Typically, keywords are entered 
by the user. However, the keyword list may also be culled &om conmion terms in selections 
made by the user or to reflect the user* s category choices in building queries . 

RcfetringtoHG. 12,onceaseardiisinvoked, the os^ sees the ovendew 

10 worid. This view is invoked by pressing the start button 228 m search mode. Alternatively, an 
overview button may be provided on the remote control 210.The ovoview mode shows a 
visual representation that indicates pictoriaUy, the relevance of each returned record by some 
metaphor for hierarchy. Each record returned by the seardti is displayed as a hexagonal tile in 
HG. 12JFor example as diown in no. 12, the apparent proximity of tibe results relative to 

IS the viewer corresponds to the goodness of the fit betwera the search critma and the record. 
Also, the record S 10 is shown with bold lines, lar;^ overall dimensions, and bold text 
oonq»ared to the record 535.11ie more relevant results are located toward the center of the 
display as well. There is an elemmt diat indicates die criteria from which the current result 
display was generated at SSO.The result tiles 510, 525, etc. can be navigated using the cursor 

20 keys 212, 232.Selecting a tile opens it up to reveal further information about the selected 
item. A tile r^xresenting a program *TIere's Kitty" is shown selected at SlO.Thus, additional 
information is shown for this selection. 

Using the cursor keys, the user can navigate to the criteria element 510.1n one 
OTibodiment consistent with FIG. 12, the vertical and horizontal cursor keys 212, 232, are 

25 usedto move the cursor about the X-Y projection plane (the plane of the screen, where the Z- 
axis is pictorial axis leading fix>m forcground to background) so that any icon can be accessed 
using die two axes of movement In an altemative embodiment, the cursor keys 212, 232 are 
used to move along the Z-axis so that the backgroxmd tiles come closer to the user and more 
information becomes Visible when they do. In this embodiment, Z-axis control can be toggled 

30 on and off or one set of cursor keys, say the vertical cursor keys 214, may be used to move 
forward and backward along the 2^axis die odier set, among the current foreground set of 
tiles. When gping in the forcgroundrto-background direction, the current forcground set of 
tUes disappears as if it moved behmd die viewer. 
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Selecting the criteria element, by pressing the GO button, 214 causes the 
display to change back to the search mode witfi the current search (&e one indicated by the 
criteria element) loaded into the search bin 140 (or the conesponding element for the other 
embodiments).This permits the search to be edited easily. 
5 Referring now to HG. 13, the results are displayed in a fashion similar to that 

of HG. 12, except that the third dimension displacement element is not applied. Hiat is, the 
less relevant records are further from Ae center and less bold, but they do not q»pear to 
recede into die background as in the FIG. 12 embodimimL Othes: features are essratially the 
same as that of the HG. 12 embodimenL 

10 Referring now to no. 14» the results of a search are organized around 

substantially coDCcatnc rings 605JBadi record appem as a bead or tdkra 610» 620, 630.The 
rings 6QS are intraided to give the appearance of a tunnel going back away from the viewer. 
The horizontal cusor keys 232 may be used to rotate die currently selected tokan (Token 605 
is the selected tokm in HG. 14).The vertical cursor keys 212 may be used to move along the 

IS Z-axis* that is, move tfuoug^ flie tunnel bringing the background rings into the foreground 
As the rings 60S move forward (the viewer advances along the Z-axis), the tokens 610, 620, 
^0, come closer to the viewer and get bigger. As tfiey get bigger, more infonnation may be 
revealed' so fliat, for example, the tide gives way to a summary, which ^ ves way to a detailed 
description. Alternatively, other media types may be mvoked, such as audio, video, screra 

20 caps (thumbnails), etc. These are ^licable to all the embodimrats described herein. 

Here, as in the earli^ embodiments, the selection element 554 provides a 
visual reminder of the selection criteria that produced the current result display and a 
mechanism for moving back to die relevant search mode to edit the criteria. Again, suitable 
navigation keys can be provided to allow for fast access to any of these features. Each ring 

25 may be associated with a match-qualit/ level that may be shown on the screen as at 566. 

Referring to FIG. 15, this embodiment of an overview world seme is similar 
to that of FIG. 14, except that the tokens are organized around a spiral 666 rather than rings. 
This arrangement is essentially one-dimensional so that only one set of cursor keys needs to 
be used to navigate it Navigation may or may not be attended by movement along the Z-axis, 

30 as preferred. 

Refilling to HG. 16A,apureiy text mbodimentmiakBS use of the three-space 
visualization to separate the different portions of the display. The diagram shows the 
d^nition of the three planes and axes. Referring now also to HG. 16B, in die UI represents 
categories 703 distributed along the Y-axis and die category selections 701 broken out in the 
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X-Y plane and distributed along X-axis. Time 702 is shown along the 2^axis. Tlie user 
profile 706 is shown in the Y-Z plane. The search title 705 and its elements 704 are shown in 
the X-Z plane. Selected items are shown in brackets. The role of the search bin 140 is played 
by the xz plane as shown at 704 and 70Silefening now also to HG. 17, the results of 
5 searches may be represented as text icons in a three-dim^onal landscape scene. The 

foreground title is the most relevant as indicated by the relevancy scale 814 in the Y-Z plane. 
Tbe less relevant results 802, 803 dppcdoc in order of relevancy progressively along the Z-axis 
away from the viewer. Die brackets 817 around the most relevant record indicate that this 
record is currently selected A selected record may reveal detailed infonnation a^^ 

10 record, for example as shown at 804.The details may include a thumbnail picture or video. 
The details may include a thumbnail picture or video (not shown).The revealing of furtiier 
detail, the zoomed-in state, can be invoked by a separate operation so that selection does not 
necessarily cause the display of additional information about the selected item. This applies 
to all embodiments. The cursor keys may be used to saoU back toward the less relevant 

IS records and to M^ght each record in turn. 

In each of the dx)ve embodinoents, one or more of the cfrtegories noay act^ 
be constructed of words or other symbols, for exanq>le, the keyword category descnbed 
above. Eeywozds could be eveiy conceivable word in the dictionary, which would make 
selection of keywords difBcult without a keyboard (physical keyboard or on-screra 

20 equivalent)JS:eyboards are tedious and it is prefeoed if keywotxls can simply be selected 
fnnn, for example, a categcny string as discussed above. 

Such a keyword category may be constructed using data fixim various sources to cull Irom 
the vast number of alternatives, those words that would be useful in a keyword selection list 
Tbe words can be extracted £com the descriptions of chosen records and/or from recotds 

25 returned by the quedes based on finequency of occurrence or a variation thereof. 

Refitting to HG. 18, a us^ accesses the records of the database directly or by 
searching. Duectly accessing records of the database could correspond, for example, to the 
. browsing and selection of a record by a user. Searching may be performed as discussed 
above. Hie us^ does one or the other and the path is selected in step S150.If a search is 

30 porformed (step SlOO) records may be a word list is constructed from the search results in 
step S115.Some or all words from the titles, descriptions, contents of the records etc. could 
be culled from the search results depending on the edacity of the system and tiie desires of 
the designer. Less relevant words, based on grammatical parsing, could be filteied out of the 
list For example, the list could be formed from only direct objects and subjects from 
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sentences in the desoiption and title words. Once Ae list is fanned, the most common words 
in the list may be identified (S120) and ranked (S125) based on ftequency of occurrence and 
significance (e.g., title words are mors significant the words from the description or the 
content of the record itself).Other criteria may be used for selecting and ranking the words 
S added to (bo list, for example, the goodness of fit between the search criteria and die retrieve< 
records. The above are mere suggestions. Hie criteria used would depend on the type of 
database accessed For example, some records may contain many different specialized fields 
such as assignee, inventor, and filing dale of a patent, that characterize the records that 
provide significance information explicitly. The common words that remain at the top of the 

10 list in tenns of significance and fi^eqtj^ncy become part of the list along widi their respective 
ranking data and the process is rqieated each tune searches are made. Repeated searches ma} 
build the list, but the list will always remain sorted with the most inqportant items at the top. 
Using die user intraiace designs described above, the most important keywords will always 
appear on the screen and the least important ones will be available by scrolling, or rolling, tfai 

15 bead string (or other conesponding element).]h this way the int^ace remams uncluttered 
while still providmg access to a lar^ inventory of keywords. 

If file mer chooses to simply select records without searching, the word list 
can be formed fiom multiple selections and common words culled fiom this list in a maun^ 
similar to that for searches. In step S 1 10, one or more records are selected by the usGt. Step 

20 SllO can be reached directly without searching or by going through the steps S100-S130 firs^ 
and thm throu^^ SISO again to arrive at SllO to choose one or more records fiom the search 
results. In step S13S, the user adds words from the selected record or reccmls to the word list 
To identify frequency of hits data on descriptors, it desirable to have multiple records, so 
each selection is added to a single list and the frequency data derived fit)m the combined list, 

25 which covers multiple selection iterations. Alternatively, if a large numb^ of records are 

selected at once, frequency data can be obtained from these selections. Hie addition of words 
to the list may involve die same Sitting and soiling steps discussed above witii respect to tfai 
words culled from the search results. In step S140, words with a low frequency of hits may 
be filtered out of the list, hi step S14S, all the terms are ranked according to the various 

30 criteria discussed above. Note that the word lists derived firom retrieved records from a searcl 
and diose derived from selected records can be combined in a single list 

Preferably, the keyword list should be editable by the user in die same fashion 
as described in detail widi respect to the editmg of profiles elsewhere in the specification. To 
construct akeyword list based on fiequency of use data, the system could start with no 
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keywoids at all. Tlieii, each time the user enters a query, the returned results could be 
scanned for common terms. The titles, descriptions, or any other data could be scanned and 
those terms that occur with some degree of frequency could be stored in a keyword list The 
keywoids in the list could each be ranked based on frequency or ficequency weighted by the 
5 context in which the keyword appeared For example, a keyword m a tide might receive a 
lower rank than a keyword in a description or a keyword that is a direct object or subject in a 
granunatical parsing of a sentrace in a description might receive a higher ranking than 
indirect objects, etc. Instead of extracting keywords from ttie returned records of a search, the 
keywords could be extracted from only the records selected for use. For ^cample, only 

10 programs that are chosen for viewing or recording are actually used to form the keyword list 
in the manner described. Alternatively botii selections and returns of queries could be used, 
but tiie keywords in die selected records could be wdg^ted more strongly than keywords in 
other returned records . This shorter list can tiien be ranked using the same or similar method 
as used to fixim would be awkward. 

IS Where the strings represent oiteria, the ranking of criteria in each category 

may correspond to the fiequency witii which tfie criteria are used by the user in constructing 
queries. So, for example, if ttie user's searches always include the daytime time range, the 
bead or beads correqxmding to this time range would be racked hi^^. Alternatively, die 
criteria may be ranked according to selected records, ratiier than by all die records (or at least 

20 the most highly ranked ones) returned by searching. 

Note that many of the above techniques can be used with other types of user 
interfaces and are not limited to the derigns described, which are prefmed embodiments. So, 
for exan^le, ttie keyword list could be used with a purely textual compute interface. 

In keeping with the design philosophy around which the user interface is 

25 developed, it is desired fliat only a smaUnumbtt- of WgWy relevant criteria be visible on ft^ 
screen at a givwi time. Across all categories, the frequency with which the us^ selects a 
given crit^on is preferably be used to rank die criteria in order of importance. Thus, 
although a television database describes content on more than 100 channels, if only 5 of those 
channels are routinely entered in search queries, those 5 channels should be, by default, die 

30 ones displayed in the most foreground or prominent position on the display. The other criteria 
are still accessible, but the interface does not innocentiy provide die user with equal access to 
aD. That is one of the basic ideas diat leads to sinq)le intecfu:es.. 

Note diat prioritization of the search criteria categoric may also be made 
editable by die user. For example, if a channel has falloi temporarily into disfavor judgmg by 
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frequency of use during the Olympics, the usex may provided a mechanism to revive it Hiis 
may be any of various techniques, for example invoking a menu option to lesoit the list 
iqpresmting the lankmg of selected category's elements, and does not need to be described in 
detail. 

5 It will be evident to those skilled in tfie art that the invention is not limited to 

the details of the foregoing illustrative embodiments, and that the present invention may be 
embodied in other specific forms without departing from the spirit or essential attributes 
theaceof . The present embodimmts are therefore to be considered in all respects as illustrative 
and not restrictive, the scope of the invention being indicated by the appended claims rather 
10 than by the foregoing description, and all dianges whidi come within the meaning and range 
of equivalency of (he claims are therefore intm^ to be embraced theiitin. 
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CLAIMS: 



L A database searching device, comprising: 

a controller (240) ynfh a display (230), an input device (210), and connectable 
to a database containing searchable lecoids; 

said control!^ being progranuned to display synibols represCTting control 
5 criteria (123) to be selectively incorporated in a search query; 

said criteria symbols being grouped into categories (155); 

each of said criteria in at least one of said categories having a ranking 
according to a parameter; 

said controller being programmed to generate a scene (90) having more ttian 

10 two axes; 

said controller being programmed to display said criteria in a distribution of 
said symbols along a first of said more than two axes according to one of said categories and 
said ranking; 

said controller being programmed to display said criteria in a distribution of 
IS said symbols along a second of said more than two axes according to the other of said 
categories and said ranking; 

said ccmtroller being programmed to accept commands to include selected 
ones of said criteria in a search query. 

20 Z A device as in claim l,wherem said scene is a three-dimensional scrae (90) 

and said more than two axes is three axes. 

3. A device as in claim l,wheiein said controller is programrned to represent 

said symbols corresponding to said criteria, other than said selected ones of said criteria, in a 
25 first region (120) of said scene and to rqnresent said control criteria and said symbols 
corresponding to said selected ones of said criteria in a second region (121) of said scene, 
said first and second regions being displaced with respect to each otfier along one of said 
first, second, and a third of said more than two axes. 
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4. A device as in claim 3, whetein said fitst and second regions being displaced 

with lespect to each otho: along said third of said more than two axes. 

5 5. A device as in claim 1, wher&in: 

said controller is programmed such that said scene is a three-dimensional 

scene; 

said controller is programmed to display said criteria in a distribution of said 
symbols along said first of said more than two axes according to said ranking; and 
10 said first axis joins a foreground of said seem and a background of said scene. 

6. A device as in claim 5, wherein saidranking r^resents a fi^equracy of with 

which respective ones of said criteria were previously incorporated in queries. 

15 7. A device as in claim 5, whei:e[n said database is an electronic program gm 

database. 

8. An electronic program guide user interface, conqnising: 

a controller (240) witfi a display (230) and input cbvice (210) connectable to a 
20 electronic program guide database; 

said controller bemg progranuned to display icons (122) representing criteria 

for searching said database in a three-dimensional seme (90) having first, second, and third 

axes; 

said controller providing for selection of said criteria for incorporation in 
25 search queries and selection of said criteria in preparation for incorporation in said search 
queries; 

said search criteria being organized into first, second and third independent 
groups according to frequency of incorporation in search queries, whether said criteria are 
currently selected for incorporation in a current search query, whether said criteria are 
30 currently selected in preparation for incorporation in said search queries, respectively; 

said icons representing criteria in said first groiq) being displaced relative to 
oiteria not in said first groiq> along said first axis; 

said icons representing criteria in said second group being displaced relative to 
critma not in said second group along said second axis; 
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said icons lepresenting criteria in said third group being displaced lelative to 
criteria not in said tbiid group along said third axis. 

9. A user interface as in claim 8, wherein said icons have the same shape 
S irrsspective of Aeir positions in said scene. 

10. A user interface, as in claim 8, wherdin: 

said three-dimensional scene has a foreground and a background; 
said tfauxi axis connects said foreground with said background; 
10 said criteria in said thud group are selected in preparation for incorpoiation in 

said search query; 

said icons representing critma not in said third grot^ are at least one of: 
smaller than, displayed at a lower contrast than, and at least partially hidden by icons 
representing criteria in said third group. 

15 

11. A user interface, as in claim 8, wherein said icons are rendered to givethe 
qppearance of bemg tfareeKBm^isional objects. 

12. A user interface, as in claim 8, wherein: 

20 said tfaiee-dim^isional scene has a foreground and a background; 

said third axis connects said foreground with said background; 
said criteria in said third group are selected in preparation for incorporation in 
said search query; 

said icons representing criteria in said third group are rendered to give the 
25 appearance of being closer to a point of view for rradering said three-dimensional scene than 
said icons represrating criteria not in said third group. 

13. A data access device, comprising: 

a controller (240) with a display (230) and an input device (210) connectable 

30 toadatabase; 

said controllCT bdng programmed to render a three-dimensional scene (90) 
having objects (105); 

said seme containing criteria objects (122) among said objects, said criteria 
objects representing criteria that may be incorporated in a search queiy; 
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said critma being grouped into categories (155); 
said scene having a foreground and a background; 

said scene being tendeied such as to aggregate said criteria objects 
corresponding to the same one of said categories such as to define respective structures (105) 
located in respective portions of said scene; 

said scene being rendered such as to aggregate ones of said criteria for 
inclusion in a current search query such as to define another structure (140, 165) located in a 
respective portion of said scene (121); 

sai d controller being programmed to permit a selection of a one of said criteria 
objects for inclusion in said current search query and to rqpresent said selection by changing 
said scene so as to move said one of said criteria fiom its respective structure to said anoth^ 
structure. 

14. Adataaccess device, con^xrising: ~ ; 
a controller (240) with a display (230) and an input device (210) connectable 

toadatabase; 

said controller being programmed to render a scene (90) having obj^ts (123); 

said scrae containing criteria objects (123) among said objects, said criteria 
objects r^resenting criteria that may be incorporated in a search query; 

said crit^a being grouped in categories; 
said scene having three dimensions; 

said controller being programmed to accept commands .fiom said input device 
and to reorganize said objects responsively diereto; 

an organization of said objects representing said search query, whereby a 
reorganization of said objects via said commands is effective to edit said query; 

said organization of said objects being asymmetric such as to differentiate 
objects according to tiheir respective positions along respective dimensions according to 
whetiier each object is at least one of: currently selected, firequentiy selected in the past, 
recentiy selected in the past, and a category in which said each object is grouped. 

15. A device as in claim 14, whoem each of said respective dimensions 
corresponds to a characteristic of said objects, said characteristics including whether a given 
object is currently selected, the fiiequracy witii which said gLven object was selected in tiie 
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pasty how tecently said given object was selected in the past, and a category in which said 
given object is grouped. 

16. A device as in claim 14, wherein said controller is programmed such that a 
5 movement of a criteria object from a first position (155) in said scene to a second position 

(121) in said sc&xe indicates an inclusion of a criterion corresponding to said criteria object in 
asearchqu^. 

17. A device as in claim 15, whemn said controller is programmed such that a 
10 movement of said criteria object £com said second positi<»i in said seme to said first position 

in said scene indicates a removal of said critmon corresponding to said criteria object in said 
search query. 

18. A device as in claim 14, wherein said controller is programmed such that a 
IS movement of said crit^a object fitom said second position in said seme to said first position 

in said scene indicates a removal of said criterion corresponding to said critma object in said 
search query. 

19. A metiiod of graerating a user interface for forming search queries and 
20 displaying results, comprising the steps of: 

aerating a three-dinaiensi<Hial scene on a display, said scene containing 
objects corresponding to search criteria; 

accepting commands to modify said scene; 
modifying a search query being defined or edited responsi vely to said step of accepting; 
25 said three^mraisional scene being asymmetric such that varying positions 

along a given dimension indicate variation with respect to a characteristic corresponding to 
that dimension. 
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